on the distaff side
(old-fashioned) on the woman’s side of the family